PlantPlotGAN: A Physics-Informed Generative Adversarial Network for Plant Disease Prediction

Monitoring plantations is crucial for crop management and producing healthy harvests. Unmanned Aerial Vehicles (UAVs) have been used to collect multispectral images that aid in this monitoring. However, given the number of hectares to be monitored and the limitations of flight, plant disease signals become visually clear only in the later stages of plant growth and only if the disease has spread throughout a significant portion of the plantation. This limited amount of relevant data hampers the prediction models, as the algorithms struggle to generalize patterns with unbalanced or unrealistic augmented datasets effectively. To address this issue, we propose PlantPlotGAN, a physics-informed generative model capable of creating synthetic multispectral plot images with realistic vegetation indices. These indices served as a proxy for disease detection and were used to evaluate if our model could help increase the accuracy of prediction models. The results demonstrate that the synthetic imagery generated from PlantPlotGAN outperforms state-of-the-art methods regarding the Fr\'echet inception distance. Moreover, prediction models achieve higher accuracy metrics when trained with synthetic and original imagery for earlier plant disease detection compared to the training processes based solely on real imagery.Comment: Accepted in IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 202

Remote Sensing of Explosives-Induced Stress in Plants: Hyperspectral Imaging Analysis for Remote Detection of Unexploded Threats

Explosives contaminate millions of hectares from various sources (partial detonations, improper storage, and release from production and transport) that can be life-threatening, e.g., landmines and unexploded ordnance. Exposure to and uptake of explosives can also negatively impact plant health, and these factors can be can be remotely sensed. Stress induction was remotely sensed via a whole-plant hyperspectral imaging system as two genotypes of Zea mays, a drought-susceptible hybrid and a drought-tolerant hybrid, and a forage Sorghum bicolor were grown in a greenhouse with one control group, one group maintained at 60% soil field capacity, and a third exposed to 250 mg kg-1 Royal Demolition Explosive (RDX). Green-Red Vegetation Index (GRVI), Photochemical Reflectance Index (PRI), Modified Red Edge Simple Ratio (MRESR), and Vogelmann Red Edge Index 1 (VREI1) were reduced due to presence of explosives. Principal component analyses of reflectance indices separated plants exposed to RDX from control and drought plants. Reflectance of Z. mays hybrids was increased from RDX in green and red wavelengths, while reduced in near-infrared wavelengths. Drought Z. mays reflectance was lower in green, red, and NIR regions. S. bicolor grown with RDX reflected more in green, red, and NIR wavelengths. The spectra and their derivatives will be beneficial for developing explosive-specific indices to accurately identify plants in contaminated soil. This study is the first to demonstrate potential to delineate subsurface explosives over large areas using remote sensing of vegetation with aerial-based hyperspectral systems

Leveraging very-high spatial resolution hyperspectral and thermal UAV imageries for characterizing diurnal indicators of grapevine physiology

Efficient and accurate methods to monitor crop physiological responses help growers better understand crop physiology and improve crop productivity. In recent years, developments in unmanned aerial vehicles (UAV) and sensor technology have enabled image acquisition at very-high spectral, spatial, and temporal resolutions. However, potential applications and limitations of very-high-resolution (VHR) hyperspectral and thermal UAV imaging for characterization of plant diurnal physiology remain largely unknown, due to issues related to shadow and canopy heterogeneity. In this study, we propose a canopy zone-weighting (CZW) method to leverage the potential of VHR (≤9 cm) hyperspectral and thermal UAV imageries in estimating physiological indicators, such as stomatal conductance (Gs) and steady-state fluorescence (Fs). Diurnal flights and concurrent in-situ measurements were conducted during grapevine growing seasons in 2017 and 2018 in a vineyard in Missouri, USA. We used neural net classifier and the Canny edge detection method to extract pure vine canopy from the hyperspectral and thermal images, respectively. Then, the vine canopy was segmented into three canopy zones (sunlit, nadir, and shaded) using K-means clustering based on the canopy shadow fraction and canopy temperature. Common reflectance-based spectral indices, sun-induced chlorophyll fluorescence (SIF), and simplified canopy water stress index (siCWSI) were computed as image retrievals. Using the coefficient of determination (R2) established between the image retrievals from three canopy zones and the in-situ measurements as a weight factor, weighted image retrievals were calculated and their correlation with in-situ measurements was explored. The results showed that the most frequent and the highest correlations were found for Gs and Fs, with CZW-based Photochemical reflectance index (PRI), SIF, and siCWSI (PRICZW, SIFCZW, and siCWSICZW), respectively. When all flights combined for the given field campaign date, PRICZW, SIFCZW, and siCWSICZW significantly improved the relationship with Gs and Fs. The proposed approach takes full advantage of VHR hyperspectral and thermal UAV imageries, and suggests that the CZW method is simple yet effective in estimating Gs and Fs

Machine-learning-based quantitative estimation of soil organic carbon content by VIS/NIR spectroscopy

Soil organic carbon (SOC) is an important soil property that has profound impact on soil quality and plant growth. With 140 soil samples collected from Ebinur Lake Wetland National Nature Reserve, Xinjiang Uyghur Autonomous Region of China, this research evaluated the feasibility of visible/near infrared (VIS/NIR) spectroscopy data (350–2,500 nm) and simulated EO-1 Hyperion data to estimate SOC in arid wetland regions. Three machine learning algorithms including Ant Colony Optimization-interval Partial Least Squares (ACO-iPLS), Recursive Feature Elimination-Support Vector Machine (RF-SVM), and Random Forest (RF) were employed to select spectral features and further estimate SOC. Results indicated that the feature wavelengths pertaining to SOC were mainly within the ranges of 745–910 nm and 1,911–2,254 nm. The combination of RF-SVM and first derivative pre-processing produced the highest estimation accuracy with the optimal values of Rt (correlation coefficient of testing set), RMSEt and RPD of 0.91, 0.27% and 2.41, respectively. The simulated EO-1 Hyperion data combined with Support Vector Machine (SVM) based recursive feature elimination algorithm produced the most accurate estimate of SOC content. For the testing set, Rt was 0.79, RMSEt was 0.19%, and RPD was 1.61. This practice provides an efficient, low-cost approach with potentially high accuracy to estimate SOC contents and hence supports better management and protection strategies for desert wetland ecosystems

Data-Driven Artificial Intelligence for Calibration of Hyperspectral Big Data

Near-earth hyperspectral big data present both huge opportunities and challenges for spurring developments in agriculture and high-throughput plant phenotyping and breeding. In this article, we present data-driven approaches to address the calibration challenges for utilizing near-earth hyperspectral data for agriculture. A data-driven, fully automated calibration workflow that includes a suite of robust algorithms for radiometric calibration, bidirectional reflectance distribution function (BRDF) correction and reflectance normalization, soil and shadow masking, and image quality assessments was developed. An empirical method that utilizes predetermined models between camera photon counts (digital numbers) and downwelling irradiance measurements for each spectral band was established to perform radiometric calibration. A kernel-driven semiempirical BRDF correction method based on the Ross Thick-Li Sparse (RTLS) model was used to normalize the data for both changes in solar elevation and sensor view angle differences attributed to pixel location within the field of view. Following rigorous radiometric and BRDF corrections, novel rule-based methods were developed to conduct automatic soil removal; and a newly proposed approach was used for image quality assessment; additionally, shadow masking and plot-level feature extraction were carried out. Our results show that the automated calibration, processing, storage, and analysis pipeline developed in this work can effectively handle massive amounts of hyperspectral data and address the urgent challenges related to the production of sustainable bioenergy and food crops, targeting methods to accelerate plant breeding for improving yield and biomass traits

Effects of Ambient Ozone on Soybean Biophysical Variables and Mineral Nutrient Accumulation

The effects of increasing ambient ozone (O3) concentrations on food security has become a major concern as the demand for agricultural productivity is projected to increase significantly over the next several decades. In this contribution, the responses of common soybean genotypes (AK-HARROW, PI88788, DWIGHT, PANA, and WILLIAMS82) to ambient O3 are characterized using hyperspectral data and foliar biophysical, mineral nutrient concentrations and soybean yield. Specifically, leaf reflectance spectra measured at different growth stages and canopy layers were used to examine the spectral indices that were most strongly correlated with leaf physiological status. The effects of elevated O3 on six important nutrients (K, Ca, Mg, Fe, Mn and Cu) were evaluated by analyzing the variations in nutrient concentrations at two critical growth stages with increasing ambient O3 concentration using Partial Least Square Regression (PLSR). Lastly, the identified best spectral indices and the robust nutrient prediction models were extrapolated to the entire growth period to explore their ability to track the effects of ambient O3 concentrations on soybean physiology and nutrient uptake. The results showed that fluorescence yield (ΔF/Fm’) and photochemical quenching (qP) appear to be good indicators of soybean physiological responses to O3 stress that are echoed by the harvest index (HI). Newly identified normalized difference spectral index (NDSI) [R416, R2371] always had the highest correlation (R2 > 0.6) with ΔF/Fm’, qP and electron transport rate (ETR, μmol m−2 s−1) compared to the published indices. Additionally, there were significant and broad spectral regions in visible and near infrared region that were well-correlated with ΔF/Fm’ and selected NDSIs that were applicable to satellite observations. The results of nutrient modeling using PLSR explained 54–87% of the variance in nutrient concentrations, and the predicted mineral nutrient accumulation throughout the growing season reflected the responses of ozone tolerant and sensitive genotypes well. NDSI [R416, R2371] demonstrated great potential in regard to its sensitivity in tracking plant physiological responses to changing ambient O3 concentrations. The outcome of this research has potential implications for development of space-based observation of large-scale crop responses to O3 damage, as well as for biotechnological breeding efforts to improve ozone tolerance under future climate scenarios

SBAS Analysis of Induced Ground Surface Deformation from Wastewater Injection in East Central Oklahoma, USA

The state of Oklahoma has experienced a dramatic increase in the amount of measurable seismic activities over the last decade. The needs of a petroleum-driven world have led to increased production utilizing various technologies to reach energy reserves locked in tight formations and stimulate end-of-life wells, creating significant amounts of undesirable wastewater ultimately injected underground for disposal. Using Phased Array L-band Synthetic Aperture Radar (PALSAR) data, we performed a differential Synthetic Aperture Radar Interferometry (InSAR) technique referred to as the Small BAseline Subset (SBAS)-based analysis over east central Oklahoma to identify ground surface deformation with respect to the location of wastewater injection wells for the period of December 2006 to January 2011. Our results show broad spatial correlation between SBAS-derived deformation and the locations of injection wells. We also observed significant uplift over Cushing, Oklahoma, the largest above ground crude oil storage facility in the world, and a key hub of the Keystone Pipeline. This finding has significant implications for the oil and gas industry due to its close proximity to the zones of increased seismicity attributed to wastewater injection. Results southeast of Drumright, Oklahoma represent an excellent example of the potential of InSAR, identifying a fault bordered by an area of subduction to the west and uplift to the east. This differentiated movement along the fault may help explain the lack of any seismic activity in this area, despite the large number of wells and high volume of fluid injected

Urban tree species classification using UAV-based multi-sensor data fusion and machine learning

Urban tree species classification is a challenging task due to spectral and spatial diversity within an urban environment. Unmanned aerial vehicle (UAV) platforms and small-sensor technology are rapidly evolving, presenting the opportunity for a comprehensive multi-sensor remote sensing approach for urban tree classification. The objectives of this paper were to develop a multi-sensor data fusion technique for urban tree species classification with limited training samples. To that end, UAV-based multispectral, hyperspectral, LiDAR, and thermal infrared imagery was collected over an urban study area to test the classification of 96 individual trees from seven species using a data fusion approach. Two supervised machine learning classifiers, Random Forest (RF) and Support Vector Machine (SVM), were investigated for their capacity to incorporate highly dimensional and diverse datasets from multiple sensors. When using hyperspectral-derived spectral features with RF, the fusion of all features extracted from all sensor types (spectral, LiDAR, thermal) achieved the highest overall classification accuracy (OA) of 83.3% and kappa of 0.80. Despite multispectral reflectance bands alone producing significantly lower OA of 55.2% compared to 70.2% with minimum noise fraction (MNF) transformed hyperspectral reflectance bands, the full dataset combination (spectral, LiDAR, thermal) with multispectral-derived spectral features achieved an OA of 81.3% and kappa of 0.77 using RF. Comparison of the features extracted from individual sensors for each species highlight the ability for each sensor to identify distinguishable characteristics between species to aid classification. The results demonstrate the potential for a high-resolution multi-sensor data fusion approach for classifying individual trees by species in a complex urban environment under limited sampling requirements

Effects of Ambient Ozone on Soybean Biophysical Variables and Mineral Nutrient Accumulation

The effects of increasing ambient ozone (O3) concentrations on food security has become a major concern as the demand for agricultural productivity is projected to increase significantly over the next several decades. In this contribution, the responses of common soybean genotypes (AK-HARROW, PI88788, DWIGHT, PANA, and WILLIAMS82) to ambient O3 are characterized using hyperspectral data and foliar biophysical, mineral nutrient concentrations and soybean yield. Specifically, leaf reflectance spectra measured at different growth stages and canopy layers were used to examine the spectral indices that were most strongly correlated with leaf physiological status. The effects of elevated O3 on six important nutrients (K, Ca, Mg, Fe, Mn and Cu) were evaluated by analyzing the variations in nutrient concentrations at two critical growth stages with increasing ambient O3 concentration using Partial Least Square Regression (PLSR). Lastly, the identified best spectral indices and the robust nutrient prediction models were extrapolated to the entire growth period to explore their ability to track the effects of ambient O3 concentrations on soybean physiology and nutrient uptake. The results showed that fluorescence yield (ΔF/Fm’) and photochemical quenching (qP) appear to be good indicators of soybean physiological responses to O3 stress that are echoed by the harvest index (HI). Newly identified normalized difference spectral index (NDSI) [R416, R2371] always had the highest correlation (R2 > 0.6) with ΔF/Fm’, qP and electron transport rate (ETR, μmol m−2 s−1) compared to the published indices. Additionally, there were significant and broad spectral regions in visible and near infrared region that were well-correlated with ΔF/Fm’ and selected NDSIs that were applicable to satellite observations. The results of nutrient modeling using PLSR explained 54–87% of the variance in nutrient concentrations, and the predicted mineral nutrient accumulation throughout the growing season reflected the responses of ozone tolerant and sensitive genotypes well. NDSI [R416, R2371] demonstrated great potential in regard to its sensitivity in tracking plant physiological responses to changing ambient O3 concentrations. The outcome of this research has potential implications for development of space-based observation of large-scale crop responses to O3 damage, as well as for biotechnological breeding efforts to improve ozone tolerance under future climate scenarios

Quantitative Remote Sensing of Land Surface Variables: Progress and Perspective

The land is of particular importance to the human being, not only because it is our, as well as terrestrial biomes’, habitat, but the land surface also plays a unique role in the Earth system [...